Stochastic Perron’s method for optimal control problems with state constraints
نویسنده
چکیده
We apply the stochastic Perron method of Bayraktar and Sîrbu to a general infinite horizon optimal control problem, where the state X is a controlled diffusion process, and the state constraint is described by a closed set. We prove that the value function v is bounded from below (resp., from above) by a viscosity supersolution (resp., subsolution) of the related state constrained problem for the Hamilton-Jacobi-Bellman equation. In the case of a smooth domain, under some additional assumptions, these estimates allow to identify v with a unique continuous constrained viscosity solution of this equation.
منابع مشابه
Stochastic Perron’s Method and Verification without Smoothness Using Viscosity Comparison: Obstacle Problems and Dynkin Games
We adapt the Stochastic Perron’s method in [1] to the case of double obstacle problems associated to Dynkin games. We construct, symmetrically, a viscosity sub-solution which dominates the upper value of the game and a viscosity super-solution lying below the lower value of the game. If the double obstacle problem satisfies the viscosity comparison property, then the game has a value which is e...
متن کاملA Method for Solving Optimal Control Problems Subject to Probabilistic Affine State Constraints for Linear Discrete-time Uncertain Systems
Recently, optimal control problems subject to probabilistic constraints have attracted much attention in many research fields. Although it is not straightforward to handle probabilistic constraints in an optimization problem, several methods haven been proposed to handle probabilistic constraints. This paper examines probabilistic constrained optimal control problems for linear discrete-time sy...
متن کاملSolution of Bang-Bang Optimal Control Problems by Using Bezier Polynomials
In this paper, a new numerical method is presented for solving the optimal control problems of Bang-Bang type with free or fixed terminal time. The method is based on Bezier polynomials which are presented in any interval as $[t_0,t_f]$. The problems are reduced to a constrained problems which can be solved by using Lagrangian method. The constraints of these problems are terminal state and con...
متن کاملParallel computation framework for optimizing trailer routes in bulk transportation
We consider a rich tanker trailer routing problem with stochastic transit times for chemicals and liquid bulk orders. A typical route of the tanker trailer comprises of sourcing a cleaned and prepped trailer from a pre-wash location, pickup and delivery of chemical orders, cleaning the tanker trailer at a post-wash location after order delivery and prepping for the next order. Unlike traditiona...
متن کاملNumerical Simulations on Feasibility of Stochastic Model Predictive Control for Linear Discrete-Time Systems with Random Dither Quantization
The random dither quantization method enables us to achieve much better performance than the simple uniform quantization method for the design of quantized control systems. Motivated by this fact, the stochastic model predictive control method in which a performance index is minimized subject to probabilistic constraints imposed on the state variables of systems has been proposed for linear fee...
متن کامل